Pull Request: Add Cross Validation Grouping and Project Settings Dialog

Summary

This pull request introduces a Project Settings Dialog to JABS, providing a user-friendly interface for configuring project-wide settings. The first setting available is the Cross Validation Grouping Strategy, which allows users to choose how cross-validation groups are defined for classifier training and evaluation.

Key Changes

• Project Settings Dialog:
  • Added a new dialog accessible from the JABS menu for configuring project-level settings.
  • The dialog is designed to be easily discoverable and includes built-in inline documentation for each setting.
• Cross Validation Grouping Strategy:
  • Users can now select between "Individual Animal" (default, original JABS behavior) and "Video" grouping strategies for cross-validation.
  • The grouping strategy directly affects how leave-one-group-out and k-fold cross-validation are performed.
  • All relevant logic and label threshold checks have been updated to respect the selected grouping strategy.
• Documentation:
  • Updated the user guide to include a section on the Project Settings Dialog, its discoverability, and a table of available settings with descriptions.
  • Inline documentation is provided within the dialog for each setting.
• Testing:
  • Added and updated unit tests to cover both grouping strategies and ensure correct behavior for label threshold logic and cross-validation splitting.

Motivation

• Make project-level configuration more accessible and user-friendly.
• Allow users to tailor cross-validation grouping to their needs
• Provide a scalable foundation for adding more project settings in the future, with built-in documentation.

Testing

• All new and existing tests pass, including those for the new grouping strategy and settings dialog.
• Manual testing confirms that the dialog is discoverable, settings are saved and applied, and cross-validation logic updates as expected.

Additional Notes

• The Project Settings Dialog is designed to be extensible; new settings can be added with minimal effort and will automatically include inline documentation.
• No breaking changes to existing projects or workflows; the default grouping strategy remains "Individual Animal."

Screenshots

Initial view:

Inline help expanded:

Training report, grouping = video, max cross validation

Training report, grouping = animal, max cross validation